Skip to content

docs: document ScoreFilter benchmark metrics for 26.04 - #1686

Merged
lbliii merged 5 commits into
26.04-stagingfrom
lbliii/filter-metrics-docs
Apr 6, 2026
Merged

docs: document ScoreFilter benchmark metrics for 26.04#1686
lbliii merged 5 commits into
26.04-stagingfrom
lbliii/filter-metrics-docs

Conversation

@lbliii

@lbliii lbliii commented Mar 31, 2026

Copy link
Copy Markdown
Contributor

Description

Documents the ScoreFilter benchmark metrics feature from PR #1385 in the Fern docs for the 26.04 release. Adds a release notes entry covering the three new metrics (num_documents_processed, num_kept_documents, throughput_docs_per_sec) and a new "Pipeline Metrics" section to the heuristic filtering guide showing how to access per-stage document counts from pipeline output.

Checklist

  • I am familiar with the Contributing Guide.
  • New or Existing tests cover these changes.
  • The documentation is up to date with these changes.

@lbliii
lbliii requested a review from a team as a code owner March 31, 2026 13:41
@lbliii
lbliii requested review from ayushdg and removed request for a team March 31, 2026 13:41
@lbliii lbliii self-assigned this Mar 31, 2026
… snippet

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Signed-off-by: Lawrence Lane <llane@nvidia.com>
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Signed-off-by: Lawrence Lane <llane@nvidia.com>

### ScoreFilter Benchmark Metrics (PR #1385)

ScoreFilter benchmarks now track document-level metrics so you can see how filtering stages affect your dataset:

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

These metrics aren't necessarily unique to ScoreFilter. Not sure if it is worth having a whole section about it in the release notes.


</Tabs>

## Pipeline Metrics

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is great, thanks.

Remove ScoreFilter-specific framing from release notes and heuristic
guide since pipeline stage metrics are not unique to ScoreFilter.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Signed-off-by: Lawrence Lane <llane@nvidia.com>
@copy-pr-bot

copy-pr-bot Bot commented Apr 6, 2026

Copy link
Copy Markdown

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Signed-off-by: Lawrence Lane <llane@nvidia.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants